Self-Regularized Prototypical Network for Few-Shot Semantic Segmentation

نویسندگان

چکیده

The deep CNNs in image semantic segmentation typically require a large number of densely-annotated images for training and have difficulties generalizing to unseen object categories. Therefore, few-shot has been developed perform with just few annotated examples. In this work, we tackle the using self-regularized prototypical network (SRPNet) based on prototype extraction better utilization support information. proposed SRPNet extracts class-specific representations from generates masks query by distance metric - fidelity. A direct yet effective regularization set is SRPNet, which generated prototypes are evaluated regularized itself. extent restore mask imposes an upper limit performance. performance should never exceed no matter how complete knowledge generalized set. With specific regularization, fully exploits offers high-quality that representative each class meanwhile discriminative different classes. further improved iterative inference (IQI) module combines prototypes. Our achieves new state-of-art 1-shot 5-shot benchmarks.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Prototypical Networks for Few-shot Learning

A recent approach to few-shot classification called matching networks has demonstrated the benefits of coupling metric learning with a training procedure that mimics test. This approach relies on an attention scheme that forms a distribution over all points in the support set, scaling poorly with its size. We propose a more streamlined approach, prototypical networks, that learns a metric space...

متن کامل

Gaussian Prototypical Networks for Few-Shot Learning on Omniglot

We propose a novel architecture for k-shot classification on the Omniglot dataset. Building on prototypical networks, we extend their architecture to what we call Gaussian prototypical networks. Prototypical networks learn a map between images and embedding vectors, and use their clustering for classification. In our model, a part of the encoder output is interpreted as a confidence region esti...

متن کامل

Semi-Supervised Few-Shot Learning with Prototypical Networks

We consider the problem of semi-supervised few-shot classification (when the few labeled samples are accompanied with unlabeled data) and show how to adapt the Prototypical Networks [10] to this problem. We first show that using larger and better regularized prototypical networks can improve the classification accuracy. We then show further improvements by making use of unlabeled data.

متن کامل

One-Shot Learning for Semantic Segmentation

Low-shot learning methods for image classification support learning from sparse data. We extend these techniques to support dense semantic image segmentation. Specifically, we train a network that, given a small set of annotated images, produces parameters for a Fully Convolutional Network (FCN). We use this FCN to perform dense pixel-level prediction on a test image for the new semantic class....

متن کامل

Dynamic Input Structure and Network Assembly for Few-Shot Learning

The ability to learn from a small number of examples has been a difficult problem in machine learning since its inception. While methods have succeeded with large amounts of training data, research has been underway in how to accomplish similar performance with fewer examples, known as one-shot or more generally few-shot learning. This technique has been shown to have promising performance, but...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Pattern Recognition

سال: 2022

ISSN: ['1873-5142', '0031-3203']

DOI: https://doi.org/10.1016/j.patcog.2022.109018